Senior / Expert AgetnicAI Engineer at AI CoE  (f/m/d)

We help the world run better. At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you. We're builders touching over 20 industries and 80% of global commerce, and we need your unique talents to help shape what's next. The work is challenging – but it matters. You'll find a place where you can be yourself, prioritize your wellbeing, and truly belong.

Summary

We are looking for a Senior / Expert (agentic) AI Engineer who can drive AI development and lead our engineering scrum teams as technical code and architecture owner. The candidate will have profound skills in Data Science, Data Engineering and Software Engineering for with an entrepreneurial spirit to join our diverse team and work on innovation projects.

Role

In this role you drive, oversee and are responsible for the entire development lifecycle of an (agentic) AI service, from PoC to productization and production operations. This requires skills and knowledge throughout the entire AI development lifecycle. You are very experienced with general software engineering best practices and enterprise-grade code development applied to the agentic AI space. Concretely this means that next to having profound genAI modeling expertise, Prompt Engineering and professional Data Engineering Pipeline development you are experienced in microservice development and deployment via professional CI/CD setup. To fully understand our stakeholders' problems and challenges a solid business acumen is needed as well. As a development leader you can motivate and guide a scrum team through complex tasks with tight deadlines.

Responsibilities / Core Tasks

• Lead develop agentic AI services from PoC to Production
• Setup and develop new Big Data pipelines, to productize data ETL workloads for different AI services
• Develop agentic AI flows that digitize business processes by writing code and prompts
• Fine tune LLMs using distributed GPU clusters
• Wrap Agents in microservices and host them on K8s exposing REST, A2A or MCP endpoints
• Work with stakeholders throughout the organization to identify opportunities for leveraging company data to drive business solutions
• Productionize AI PoCs with good software engineering by incorporating CI/CD pipelines, deployment and AgentOps
• Take ownership over AI services in development and production
• Lead, guide and mentor junior colleagues and evolve their AI engineering skillset

What you bring

• Bachelor's or master's degree in machine learning, computer science, engineering, or related technical fields
• Vast coding knowledge of at least one programming language such as Python or Java
• Deep knowledge of Distributed Computing Systems for Big Data Engineering such as Databricks (PySpark/Scala)
• Exceptional understanding of AI/ML concepts
• Very deep experience in applying AgenticAI frameworks such as Langgraph, CrewAI, Microsoft agent framework or google-adk
• Good understanding and hands on experience in agentic AI communication technologies such as MCP and A2A
• Exceptional understanding of AIOps and LLMOps/AgentOps concepts (e.g. MLflow 3.0)
• Extensive coding experience in applying ML frameworks such as Keras, scikit-learn, TensorFlow, PyTorch, Huggingface
• Vast general software engineering best-practices (e.g. Object-Oriented Programming) and experience working in a scrum-like software engineering unit
• Productization technologies and tools such as Docker, K8s, GitHub, VSCode, Linux etc.
• CI/CD and ML Ops frameworks such as Jenkins, GitHub Actions, MLFlow, etc.
• Cloud-deployment offerings such as Azure ML, Databricks, AKS, Event Hubs, Azure Data Factory, Azure Functions or similar in AWS / GCP
• Some form of code ownership and scrum team leadership experience
• Curiosity to learn about different AI applications and new technologies in general
• Excellent spoken and written knowledge of English as well as collaborative mindset; good German language skills
• Experience with SAP AI offerings e.g. AI Core, AI Business Services, Joule etc. is a plus
• Understanding of Agile / Scaled Agile (SAFe) methodologies is a plus
• Python backend development, e.g. Flask, Django, FastAPI, OpenAPI is a plus

Meet your team

Within SAP IT, our Enterprise AI CoE team has the purpose to help SAP to transform into a data-driven intelligent enterprise, by empowering SAP employees to simplify processes, leveraging AI technologies. Our vision is to be an advocate and enabler of best-in-class AI within SAP. Our mission is to deliver business value through AI in SAP’s processes and be recognized as AI Thought Leader in the market. We implement both standard SAP AI and custom built solutions across all LoBs. We are customer zero of SAP standard AI solutions and provide continuous feedback to standard development for product improvement. We provide an AI Platform and Infrastructure to entire SAP AI practitioners for building their own ML solutions in the entire ML lifecycle following MLOps methodology. Furthermore, we build and operate a central chatbot platform based on SAP Conversational AI with the aim to provide capabilities from all lines of business through a single digital assistant. We also build those capabilities (individual chatbots) as well as support other teams in building further ones. Within our team, we practice a trust-based working model with emphasis on great collaboration, agility and transparency. We offer a lot of room for creativity and freedom to experiment. Our operating model is based on autonomous/agile team concept (SAFe) and SAP New Work practice where we put people at the center of everything we do.